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ABSTRACT 

This report describes the midterm and final tests administered to pupils 
in the Quality Assurance classes using the First Year Communication 
Skills Program. The tests included both selected and constructed response 
items and were designed to be individually administered to pupils. The 
results are reported for each of eight outcome subscores (selected and 
constructed) as well as for selected response and constructed response 
subscores and the grand total. Means, standard deviations, and fre- 
quency distributions are provided for eaph. ' The results of Che final 
testing are also reported by the number of units pupils completed. 
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MIDTERM AND-J?INAL TESTING OF QUALITY ASSURANCE CLASSES 
USING THE FIRST YEAR COMMUNICATION SKILLS PROGRAM 



As part of the Quality Assurance procedures, midterm and^final tests were 
administered to a sample of the classes participating in the 1970-71 
First Year* Communication Skills Program (FYCSP). These tests were 
designed to measure pupil performance midway and at the end of the school 
year. 

The tests include items on each of the four outcomes in FYCSP: Words, 
_Word_ElementS-,_Woxd_Atj^Jc>--^nd Letter Name5~ (see Appendixes A and B). 
Achievement on each outcome was evaluated by five selected response and 
five constructed response items. The test results by outcome ^nd item 
type (selected and constructed) for both tests are presented and discussed 
in this paper. 

Sample 

Approximately five percent of all those classes using the FYCSP partici^ 
pated in Quality Assurance.-^ Midterm tests were given only to Quality 
Assurance classes which were not using the Instructional Concepts Program 
(ICP) in conjunction with FYSCP. Classes using both ICP and FYCSP were 
only given the posttest. The reason for excluding the ICP-FYCSP classes 
from midterm testing was the ICP final test (TN 5-71-46). This final 
test was administered in most classes near the middle of the school 
year. Asking these classes to administer the FYCSR midterm test would 
have added a considerable additional testing burden while providing only 
limited additional information. Since only one district in the Quality 
Assurance sample did not use the, ICP, the midterm sample only includes 
184 pupils. ^ 

The final test was administered to a much larger sample. Seventy-seven 
classes in the FYCSP Qtiality Assurance sample were sent test materials. 
However, test data from 11 of those classes who never participated in the 
program were not received. Of the 66 remaining Quality Assurance classes, 
56 returned posttest information providing scores^ for 1520 pupils.,. 

Procedures for Midterm 

In February, 1971, a packet containing midterm test sheets (covering the 
first five units of the FYCSP), stimulus cards, directions, a .cover letter 
explaining the purpose and procedures, and a prc-addressed, postage-paid 
return envelope was mailed to the teachers. The cover letter (see 
Appendix C) directed the teachers to administer the midterm test individ- 
ually to pupils between March 1, and March 12, 1971. The instructions 
emphasized that the teacher should present all items on the test to each 



The criteria for selecting the sample group are discussed in TN 5-71-54, 
"The Development of the 1970-71 Quality Assurance Procedures.'* 
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pupil in the program. The teacher had the option of testing all pupils 
on one day or staggering the testing over the time period. The direc- 
tions (see Appendix D) explained the procedures for presenting each item 
and recording each pupil* s scores. Test sheets were returned to SWRL 
via a pre-addressed, postage-paid envelope enclosed in the test packet. 

Procedurf^s for Past test ' 

The procedures for the posttest were similar to those used for the mid- 
term tests. In May, 1971, a packet containing the posttest sheets (cover- 
ing all 10 units), stimulus cards, directions (same as for the midterm), 
'a pre-addressed, postage-paid return envelope^ and a cover letter was 
sent to the teachers. Teachers were asked to administer the test anytime 
before June 4, 1971 (see Appendix E). As with the midterm, all items were 
to be presented to each pupil individually. 

Midterm Results 

Table 1 presents the results of the FYCSP midterm giving the means, 
standard deviations, and frequency distributions (both number and per- 
cent) of the scores on each section of the test. The data for the 
selected and constructed response subtotals and the grand otal are also 
included. Histograms are presented in Figures 1-3. 
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Posttest Results 

Table 2 and Figures 4-6 present the results of the post test. In general, 
the posttest results follow a pattern similar to that of the midterm 
results. 

Figures 7 and 8 give graphs, by unit completed, of the mean scores on the 
postt;est. Figure 7 gives these means for the selected response and 
Figure 8 for the constructed response subscores^ Tables 3-13 present the 
means, standard deviations, and frequency distributions on each section 
■X>£.jtha_test and the totals_3y the.jQumberi_of^ comfileted. The number 
of units completed was determined individually by looking up the last 
Criterion Exercise that was received for each pupil. For all sections 
of the posttest, ^there is a trend for the mean score to increase as the 
number of units completed increases with two notable exceptions. 

The first exception is for pupils , for whom no unit Criterion Exercises 
were received. These pupils were assumed to have completed 0 units of 
the program. The results indicate, however, that they attain higher 
scores than those pupils completing 1 or 2 units. This result appears 
to be due to incomplete Criterion Exercise information for the pupils in 
the 0 units completed group. They most likely completed at least part of 
the program, but no data were forwarded to the Laboratory for them. As 
a result, they are placed in the category of 0 units completed and 
elevate the mean score for this group. 

The second exception is more difficult to account for. Pupils completing 
five units of the program score considerably less than pupils who complete 
four units. This trend is consistent across all four program outcomes 
and both types of item responses (constructed and selected).^ However, a 
closer look at the pupils included in this category provides a partial *' 
explanation. Although 97 pupils were listed as completing unit 5, 63 
were from one school which had mean scores on each outcome which were 
considerably below the overall means. It is the lower performance 
exhibited by this particular school that accounts for the deviation from 
the trend at this point on the graphs. 
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Appendix C 
MIDTERM COVER LETTER 



Each member of the Quality Assurance sample was asked to send Criterion 
Exercises to the Laboratory, and to administer and submit mid-program and 
end-of -program performance tests. The procedures for handling these data 
were explained during a visit to your school last Fall. It is now time 
to administer the mid-program perfoi:mance test. Enclosed are the materials 
you will need to adrriinister this test. 

The test contains 40 items and is designed to be individually administered. 
Also enclosed is an instruction sheet which gives the procedures you should 
follow in administering the test, one set of stimulus cards, which is used 
to present the test items to each pupil, and an answer sheet for each pupil 
on which to record the pupil's responses. 

The test includes questions on four separate outcomes of the First -Year 
Communication Skills Program. The content covers the first five units 
of the program. You should present all items in the test to each pupil 
even though they may net have received instruction on all. five units at 
this time. ^ ' ^ 



We ask that you administer the test between March 1 ^nd March 12. You may 
test a part of your class on each day or all students on one day. After you 
iiave completed the testing you may wish to record , the scores fur your records. 
Then forward all completed answer sheets to SURL in the .enclosed pre-addressed 
envelope. 

Your cooperacion in providing this inJtormation as well as the Criterion 
Exercises is greatly appreciated. 

Sincerely J 

j.y'i // ' 'A-^- '■■>■- — - 

Ralph A. Hanson 

Quality Assurance Department 
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DIRECTIONS FOR ADMINISTERING THE FYCSP MIDTERM- AND POSTTEST 




• 

ERIC 



1. Select a testing area that is appropriate for individual testing. 
The area should be relatively quiet, 

2.. Record the student's name (first and last), teacher's name, school, 
district, and the date at the top of the answer sheet. 

3. The test is divided into 8 subtests; 5 questions in each subtest. 
The top 4 subtests are for selected responses and the bottom 4 
subtests are for constructed responses. 

4. In administering the test, complete the 4 subtests at the top of the 
answer sheet, and then the 4 subtests on the bottom. Present uhe 
stimulus cards in numerical order (numbers are at the bottom right 
hand corner). There is one stiiaalus card for each item. Read the 

^ instructions at the top of each subtest, exactly as quoted for each 
item in the subtest • For example, on Outcome 1, subtest 1, you 

,jwould read the instructions, "Point to the word for each of 

the five items, 

5. Read the instructions and then record the first response the student 
makes by circling the for a correct response or the for an 
incorrect response. If the child makes no response within 10 seconds, 
record it as an incorrect response by circling the -and then go 

to the next item. 

6. Whether or not the student gives a correct response, say "O.K,'' and 
X then go on to the next item. 

7. No hintS; verbally or by gesture, are to be given. 

8. The score for each subtest is the total number of correct answers. 
For each subtest .count the number of pins signs circles and record 
that number on the line provided at the bottom of each subtest. Add 
the number of correct selected responses together and record the 
total on the line provided. Use the same procedure for the total 
correct constructed responses. Then add the total selected and 
constructed responses together and place that grand total on the line 
at the bottom of the answer sheet. 



30 



SOUTHWEST REGIONAL LABOKATORY 1 oM KDLt ATinNAL liKSKAIiC ll UIA LLorMENT 
U3U0 LA CIENEGA BOULEVARD -INGLEVVOUD. CALIFORNIA yi)3o4 • TELEPHONE lliVMrn AREA CODE 



The information provided throughout the school year by the 
teachers and pupilb participating in the First Year Communication 
Quality Assurance Program has been extremely usetul in improving 
the program. There is one final item of information we ask that 
you provide and chis is the end of program test. 

The test contains 40 items and is designed to be individually 
administered, Enclosed vrith this letter is: 

1, An instruction sheet which gives the procedures you 
should follow in administering the Lest, 

2, Ont set of stimulus cards which is used to present the 
test items to each pupil. 

3, An answer sheet for each pupil on v/hich to record the 
pupil's responses. 

The test includes quest-f^ns on the four separate outcomes and 
content from all 10 units of the First Year Communication Skills 
Program, You should present all items in the test to each pupil 
even though they may not have received instruction on aill units 
at this time. 

We ask that you administer the test anytime before June 4, 1971, 
You may test part of your class on each day or all students 
on one day. After you have completed the testing you may wish to 
record the scores for your records. Then forward all completed 
answer sheets to SWRL in the enclosed pre-addressed envelope. 

Your cooperation in providing this information as well as the 
other Quality Assurance information throughout the school year 
is greatly appreciated. 
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POSTTEST COVER LETTER 




RalpTi A, Hanson 
Quality Assurance Program 
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